Prescriptive selection of machine learning hyperparameters with applications in power markets: Retailer"s optimal trading

We present a data-driven framework for optimal scenario selection in stochastic optimization with ap- plications in power markets. The proposed methodology relies on the existence of auxiliary information and the use of machine learning techniques to narrow the set of possible realizations (scenarios) of the variables of interest. In particular, we implement a novel validation algorithm that allows optimizing each machine learning hyperparameter to further improve the prescriptive power of the resulting set of scenarios. Supervised machine learning techniques are examined, including kNN and decision trees, and the validation process is adapted to work with time-dependent datasets. Moreover, we extend the pro- posed methodology to work with unsupervised techniques with promising results. We test the proposed methodology in a realistic power market application: optimal trading strategy in forward and spot mar- kets for an electricity retailer under uncertain spot prices. The results indicate that the retailer can greatly benefit from the proposed data-driven methodology and improve its market performance. Moreover, we perform an extensive set of numerical simulations to analyze under which conditions the best machine learning hyperparameters, in terms of prescriptive performance, differ from those that provide the best predictive accuracy.The authors gratefully acknowledge the financial support from MCIN/AEI/10.13039/501100011033, project PID2020-116694GB-I00 and from the Madrid Government (Comunidad de Madrid) under the Multiannual Agreement with UC3M in the line of “Fostering Young Doctors Research” (ZEROGASPAIN-CM-UC3M), and in the context of the V PRICIT (Regional Programme of Research and Technological Innovation)